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ABSTRACT 

The purpose of this study vas to determine whether 
interrelationships exist among the assignments an instructor plans to 
give (topic, format, and iuode), the intended use of instructional 
time, and rank order of typical comments used in annotating student 
papers. The study involved the use of a short questionnaire which 
contained three parts: (1) questions relating to the teacher's 
intended assignments (according to mode, aim, and relative 
frequency); (2) the teacher's planned use of instructional time 
during the term, rated according to amount of time on certain 
standard topics; and (3) the teacher's rank ordering of importance of 
sixteen foci of annotation. A summary of the statistical analysis 
derived from the questionnaire is given. The conclusion drawn is that 
teachers frequently send students differing signals of what is 
important in writing by means of their responses to student papers. 
The questionnaire used to obtain this information is included. 
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O 

^ This is a report on the analysis of data of the first in a series 

5? of studies which taken together will be a very comprehensive project. After 

O 

CZi quickly tracing the background of this project, I shall present the information 

UJ 

I have gathered and what my analysis indicates* 

Historical Background of the Investigation 

In 1970 at the Atlanta meeting of the NCTE a group of people 
gathered to discuss Instructor's Responses to Students' Writing ^ which was 
the title of a special interest group being started. At that first meeting 
many important ideas and statements of personal preferences, biases, and 
research relating to what we (as teachers of composition) do to students* 
papers submitted in response to our assignment* The group identified 
three goals for research in the area of responses to student writing: 

1. Get various teachers to set down what they value in writing 
and what they react to in particular when looking at 
students' papers. 

2. Analyze comments of selected instructors over a sejnester to 
determine whether patterns exist and if pattern can be 
described, 

3. Classify assignments given by different instructors to see 

. whether the assignments imply different goals/preferences in 

S teaching writing. 

^ Since Atlanta was so successful we met again and again in various 

o 

i-Assistant Professor, Curriculum and Instruction, University of Texas at 
Austin, Texas. Portions of this article were delivered as a paper at 
CCCCs New Orleans, 1973, meeting. 
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x^elationships — letters > conventions, and telephone calls — and as a group at 
each succeeding NCTE or CCCC convention, up to the Minneapolis NCTE (1972) 
meeting. 

At the NCTE meeting in Las Vegas (1971) I delivered a paper entitled 
"Design Considerations in Studies of Composition." That paper set up a research 
design fox* investigating the three goals established one year before at Atlanta» 
As it has evolved the r^esearch is divided into three parts: Study One, being 
reported here, a study of instructors '* intentions , plans , or preparatory 
thoughts about their composition classes. In the first study I attempted to 
study Goal One and part of Goal Three. Study Two, now in progress is an 
attempt to study Goals Two and Three, (Both Study One and Study Two are also 
pilot studies in that one important outcome of them will be improved methods 
of getting the information I want and need for Study Three.) 

Study Three will attempt to study all three goals over a period of 
at least three terms for each respondent, The third study will begin in 
September 19 7*1 • 

Report of the Investigation 

I shall discuss first the purpose of the study, the procedure of 

investigation, the results of the work, and then I would like to offer some 

interpretative comments. The purpose of the study was simple: 

The purpose of the study was to determine whether interrelationships 
exist among the assignments an instructor plans to give (topic, 
format, and mode), the intended use of instructional tinie, and 
rank order of typical comments used in annotating student papers. 

One way of looking closely at the purpose of the study is to consider 

the difference between analog and digital communication. Basically the 

difference is that of obvious, specific, verbally explicit signals and subtle, 

Q vague, non-verbal or verbally implicit signals. Some examples wight help to 

ERIC 
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clarify the matter* 

Analog Digital ' 

(1) Comments on papers (1) Assignment exactly as given 

(2) Instructional time '^around** the (2) Syllabus (es) 
assignment 

(3) Text selection ( Holt Guide differs (3) Use of text; when and at which 
from Harbrace Handbook ; both differ point attention is called to 
from Macrorie's Telling Writing , etc,) text, 

i^) Haptics and Kinesics (outside the areas (^) Room, lab, office arrangements; 
of study undertaken) availability teachers, 

materials (outside this study) 

A second set of comparisons should clarify the distinction further: 
If assignments are digital, then the format specified can be analog, If assign- 
ment and mode are digital, then the focus(i) of comments can be analog. If 
syllabus /class assignments are digital, then instructional time can be analogs 

Did the differing signals (analog and digital) match? Did they cross- 
over? Study One was one attempt the answer these questions, to establish some 
h3rpotheses for further study, so let me quickly summarize the research procedure. 

Research Procedure 



The study involved the use of a short questionnaire which contained 
three parts: (1) questions relating to the teacher *s intended assignments 
(according to mode, aim, and relative frequency), (2) the teacher's planned use 
of instructional time durrng the term, rated according to amount of time on 
certain standard topics, and (3) the teacher's rank ordering of importance 
on sixteen foci of annotation. One hundred and eighteen (118) questionnaires 
were sent, one to each person who had attended the meetings, or one meeting, 
of the special interest group v About 60% have responded , of that number (58) 
only thirty-six could be quantified, Thirty-six is still enough to accomplish 
the two purposes of the study — one, to test the format of the questions(the 



"pilot" aspect) and, two, the stated purpose of the study, Intercorrelation 
statistics were used to analyze the data, The entire questionnaire and relarcd 
material are appended, ' 



Results of the Study 

General Summary ^d Summary of Non-Quanti f iable Retu rns, 

Not surprisingly, there are many varieties of composition progran© 

currently. There are multi-term programs: 



First Term 

Handbook 
Case Book 
Ten themes 

Exposition 
Paragraphing 



Clarity 

Organization 

Structure 



Second Term 

Genre Reader 

Six Themes 

One Research Paper 

Argument 
Research Paper 



Sentences 

Diction 

Style 



Third Term 



Description 

Narration 

Literature 



There are a vex^y few diagnostic, need-based programs; about the same "few" 
would apply also to programs based on personal writing, and journal -based 
programs. The usage handbook plus casebook reader program seems to still be 
the most "standard." More emphasis in the programs seems to be on i nvention , 
less on arrangement or style » The basic justification for usage/error based 
programs is the obscurity problem. .. .i.e. , if the Jfiessage is obscured then 
probably a usage error has been committed. The most frequently cited authors 
are McCrimmon, Macrorie, and Hodges (Har brace Handbook ) or Irmscher ( Holt Guide) . 
Many casebook editors were mentioned; nearly all casebook titles dealt with 
social/political issues. 

My general impression irs that many, many mora courses have very 
specific, well-defined objectives than there used to be, Accountability? 



student Power? Perhaps a counter swing to the basic skills is occurring • 
Summary of Statistical Analysis t 

It 75% of subjects intended either an equal mixture of the three 
kinds of assignment or personal feeling assignments on question one. Less than 
30% cited personal feeling. That is, a total of 25% cited only expository or 
Only philosophical resolution assignments, 

2. 50% of subjects intended for over one-half of their assignments 
to have a specific format (question two)» 

3. Two-thirds of subjects indicated either "no response" or less 
than one-fourth of assignments will be devoted to description; nearly 90% did 
the same for narration, BUT 

( 4t 31% stated exposition was the focus of one-fourth to one-half 
the assignments, and 39% stated exposition was the focus of greater than 
one-half I 70% of the respondents indicated that over one-fourth of their 
assigned papers were to be written in the expository mode. 

More specific ranking, ratings, and breakdowns comparing intended 
instructional time with ranking of importance of comment foci for students ' 
papers show some very interesting data» 

Figue One represents greater than 10% of subjects in agreement. As 
you see, it happened that greater than 10% occurred but twice. Keep in mind 
please that this ranking indicates that, in the first case, 17% of subjects 
responding rated teaching of conreteness and specificity of language as being 
given over 25% of their instructional time. Broadening the ranking to include 
ratings of over 10% we get the data on the lower portion of Figure One. The 
drop in importance of paragraphing is especially significant. This data 
indicates that 20% of the teachers responding indicated that instruction in 



PLANNED INSTRUCTIONAL TIME - HIGHEST RANKINGS 



% OVER 25% OF TIME ^ AREA OF INSTRUCTION 

17 Concretaness, Specificity of 

Language 

11 Paragraphing, Topic Sentences 



% OF SUBJECTS BETWEEN 10 AND 25% AREA OF INSTRUCTION 

36 Concreteness, Specificity of 

Language 

30 Sentence Structure, Syntax 

20 Logic 

19 Researching, Use of Library, Taking 

Notes, Bibliography 

19 Introduction, Conclusion, Transitions 

Coherence 

19 Par6^graphing , Topic Sentences 

17 Nature and Ut^e of Evidence 



Figure 1 



AREAS OF ANNOTATION - RANKED PRIORITIES 



% OF SUBJECTS RANKING FIRST P3CUS 

6*+ Organization 

61 Unclear Thesis or Emphasis 

56 Detaile^i Support Lacking 

H2 Lack of Continuity, Coherence 

31 Principal Argument not Proved 

28 Inconsistency in Reasoning 

28 ; Incorrect or Doubtful Assertion 

25 Insufficient Precision 



Figure 2 



INDICATING FIRST, SECOND, OR THIRD PRIORITY 

% OF SUBJECTS ^0^^^ 

Syntax, Sentence Structure 

51^ Diction 

gi^ Inappropriate Tone or Point 

of View ^ 

Tone or Point of View Not 
Consistently Maintained 

53 Language not Vivid, not Fresh 

CO Data not Taken into Account 



Fig, 3 



INSTRUCTIONAL TIME: EXPOSITION AND PERSONAL 



EMPHASIS OF INST> TIME HIGHER RANKING GROUP 

Dialects and Levels of Usage Personal Feeling 

Fragments, Runons, Dangling Participles " " 

Comma Errors " " 

Spelling " " 

Editing, Rewriting Techniques " " 

Invention, Prewriting " " 

Paper Formats, Documentation " " 

Thesis Statement Exposition/Data 

Expository Patterns " • " 

Introductions, Conclusions, Transitions, " 
and Coherence Devices 



Fig. ^ 



MARKING PRIORITIES: EXPOSITION AND PERSONAL 



FOCUS OF MARKING 

Errors in Use of Words 

Representation of Experience 
Insufficiently Precise 

Data not Taken into Account 

Inappropriate Tone of Voice, 
Point of View 

Unclear Thesis 

Lack of Coherence 

Inaccxarate or Doubtful Assertions 

Inconsistency in Reasoning or 
Judgement 



HIGHER RANKING GROUP 



Personal Feeling 



Expos it ion/Data 



Fig. 5 



Logic 'Would have at least 10 but no more than 25% of their instructional timet 
Compare Figure One with Figure Two, which presents considerations ranked first 
in importance in reading/gipading/annotating students^ papers. That is, 6U% of 
the respondents indicated that their first priority in responding to a student *s 
paper would be focused on "organization," If I broaden the base to include first* 
second, and third in impcrtaace > the results are presented in Figure Three* I 
found that the foremost concern for nearly all teachers was "Syntax, Sentence 
Structure," There seemed to be some discrepancies in what we set out to teach 
and what we look for in students^ papers, so I narrowed my analysis to a very 
detailed study of the discrepancy patterns (in setting up instructional time 
compared to importance-ranking of typical annotation foci) of teachers indicating 
largely "expository" assignments and of those indicating largely "personal feeling 
assignments, 

t& ft 1& f« 

Insert Figures One, Two and Three about here 

A ft i*« A A 

Studying the breakdown of instructional time for each subject who 
responded "personal feeling" or "expository ^ data gathering" on question one 
(and totalling for each group) reveals the topics for instruction listed in 
Figure Four, Focus(foci) of marking are listed in order of importance; that 
is, "Errors in Use of V/ords" is more important than "Data not Taken into 

Account," Figure Five shows the marking priorities of each group, 

ft ft ft ft ft 

Insert Figures Four and Five about here 

ft ft' ft ft ft 

The group which seems to be most uncertain of priorities is the 
personal feeling group, hut the expository people are not totally consistent ♦ 



The inconsistency between instructional time and priorities in reading/grading/ 
evaluating supports the hypothesis I advanced in 1971 in Las Vegan. Namely, 
we send different signals to our students # We do it without meaning to, but 
we do do it. We do it when we say: 

"Tell me what you think, what you feel. Let me have your ideas," 
And then we give it the red pencil. 

Or When 

We shoot the bull for four or five class meetings and then grade the 
writing (done during those five to ten days) for the same items we graded for 
several weeks ago, even though we know we did not teach how to correct the 
error, how to embed the short, choppy sentences, etc. 

Two last specific bits of data will demonstrate my point. People 
who indicated a high priority (All of the "expository" group from Question One 
marked it first or second in importance) for thesis statement differed about 
how much instructional time should be devoted to studying thesis matters — 
one-half said 10% of time or less; one said zero; one-half said over 15%, two 
said over one-fourth of all the ins cruet ional time in the term^ Yet, they all 
ranked Thesis Statement as first or second in importance in their minds when 
they look at a student's paper. 

All groups marked spelling and comma errors as very high priorities 
in reading/grading/evaluating student papers, but most gave no instructional 
time to improving spelling and very little (less than 5%) instructional time 
to comma errors. 

Conclusion 

We must be sending, frequently, our students differing signals of 
what is impor-tant to uSf They have to play the game of psyching us out, but 



we, perhaps, are not even sure of what we want. He know that the best writing 
is done in a fairly relaxed setting, and I do not think our vacillation or lack 
of self-knowledge can do anything other than hinder the establishment of such 
an atmosphere in our classes. 

Continued Research 

Study Two, larger and much more complex than Study One, will be 
completed in the Summer of 1973. I have some initial feedback already, and it 
appears that it is working out well. Study Three is through the design stage 
and will shortly go into the debugging stage, and then to the printers. 

When I have cc»npleted the three studies, I shall go back through my 
files and find certain individuals who typify certain sets of patterns (of 
responses) and Professor Larson and I have tentatively discussed some very 
detailed work with those "typical" teachers in (1) studies of their classroom 
techniques (Ryans, Flanders-Amidon, etc.) and (2) studies of their attitudinal 
changes over a period of years — I already have and am getting constantly data 
useful in both of these future aspects. 

(Would you join in as a respondent? Please write to me and I'll put 
your name on the list, and when the next phase begins you will start getting 
materials . ) 



QUESTIONNAIRE (Form 1) 



1. In this course do you anticipate that your paragraph/paper 
assignments will be, for the most part: 

(A.) Data gathering and relaying/ "straight-forward" 
exposition 

(B.) Personal feeling and opinion papers 

(C.) Philosophical dilemma, paradox, or complicated 

moral issue resolution 
(D.) An approximately equal mixture? 

2. Will you expect a specific, previously determined end 
(implicitly or explicitly) stated format in 

(A.) None of the papers/paragraphs, 

(Be) Less then l/U of the papers/paragraphs. 

(C.) Between l/? and l/4 of the papers/paragraphs. 

(D.) Over 1/2 of the papers/paragraphs? 



Please indicate the appropriate fraction of your assignments 
which will be devoted to 

3« Description 

(A ) Less than l/U 

4. Narration (B. ) 1/4 

(C.) 1/4 to 1/2 

5. Fxposition (D.) Over l/2 

6. Argumentation 



Please indicate the aporoximate percentage of instructional 
time which you will devote to {5%; 5-10^; 10-15%; 15-25%; 
over 25%): 

7. Sentence Structure, Syntax 

8. Paragraphing, Topic Sentences 

9. Dialect Differences, Levels of Usage 

10. Concreteness , Specificity of Language 

11. Fragments, Run-ons, Dangling Participles 

12. Comma Errors 
13« Spelling Frrors 

14. Capitalization, Punctuation 
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15. Proofreading 

16. Fditing, Rewriting Techniques 

17. Tone, Point of View 

18. Outlining 

19. Precis Writing, Abstracting 

20. Invention, Pre-writing 
21» Thesis Statement 

22. Expository Patterns 

23. Accuracy of Material, Fects 
2U. Nature and Use of Evidence 
23. Image, Metaphor ^ Simile 

26. Introductions^ Conclusions Transitions^ Coherence Device 

27. Logic 

28. Researching, Use of Library, Taking Notes, Bibliography 

29. Paper Formats, Documentation 

30. Manuscript Typing 

31. In the, space below please submit any comments which might 
help the research^feet a better idea of the nature of your 
composition courseTs). 
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32. Please vrrite an A_ beside each item in the following list 
which you consider most important in reading/marking student ' 
papers/paragraphs, a for the second most important, £ for 
ths third, D for fourth, and an £ for the fiftht 

Some Typical Foe? In Comments by instructors In Composition 

)• Errors in spelling, punctuation 

2. Errors in syntax or sentence structure 

3* Errors in use of words, or In Idiom (Including apparent •'wrong word" 
for idea intended) 

4. Infelicities of metaphor, simile, and other figures 

5* Unclear organization (paper hard to follow) 

6. Unclear thesis or emphasis 

?• Lack of continuity (coherence) 

8. Assertions made by student inaccurate or doubtful (i. e., criticism 
of the substance of what Is said) 

$• Assertions or generalizations lack support of details (evidence) 

10. Representation of an experience insufficiently precise or detailed 

IK Language used by student lacking invividness or freshness 

12^. One or more ideas or particular pieces of data not taken Into account 
by student, and should have been 

13* Tone of voice or point of view not appropriate to subject or audience 

\k. Tone of TOice or point of view not consistently maintained through 
complete piece 

15* Inconsistency in reasoning or judgement about subject discussed 
]6« Principal argument or assertion not proved to reader's satisfaction 



Page 3 of 3 



